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Many real-world complex networks contain a significant amount of structural redundancy, in which 
multiple vertices play identical topological roles. Such redundancy arises naturally from the simple 
growth processes which form and shape many real-world systems. Since structurally redundant 
elements may be permuted without altering network structure, redundancy may be formally inves- 
tigated by examining network automorphism (symmetry) groups. Here, we use a group-theoretic 
approach to give a complete description of spectral signatures of redundancy in undirected networks. 
In particular, we describe how a network's automorphism group may be used to directly associate 
specific eigenvalues and eigenvectors with specific network motifs. 



PACS numbers: 89.75.-k 89.75.Fb 05.40.-a 02.20.-a 

I. INTRODUCTION 

Many complex real-world systems - from chemical re- 
actions inside cells [H] to technological systems such as 
the world wide web [2] - may be represented as net- 
works. Understanding the topological structure of these 
networks helps understanding the behaviour of the sys- 
tem on which they are based. Thus, there is consider- 
able interest in elucidating the origin and form of com- 
mon structural features of networks [Ij [3TJ [39]. Previ- 
ous reports have identified a variety of features which 
are common to a range of disparate networks including: 
the power-law distribution of vertex degrees [H 13 l25] : 
the 'small- world' property |41j : and network construction 
from motifs [HI [501 [32] amongst others. 

Many common network features derive from common 
ways in which real-world networks are formed and evolve. 
So, for instance, growth with preferential attachment 
naturally leads to a power-law vertex degree distribu- 
tion 15 . As another example, common replicative growth 
processes, such as growth with duplication [8J, naturally 
endow networks with a certain degree of structural redun- 
dancy. Thus, structural redundancy - in which multiple 
vertices play an identical topological role - is common in 
real- world empirical networks [27) . In terms of system 
behaviour, structural redundancy can be beneficial since 
it naturally reinforces against attack by providing struc- 
tural 'backups' should network elements fail [40 . Thus, 
network redundancy is related to system robustness [Tl[3]. 

Intuitively, two vertices are topologically equivalent if 
they may be permuted without altering network struc- 
ture. A permutation of the vertices of a network which 
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does not affect network adjacency is known as an auto- 
morphism and the set of network automorphisms forms a 
group under composition of permutations. Thus, our in- 
tuitive notion of structural equivalence may be formally 
investigated using the mathematical language of permu- 
tation groups. Crucially, symmetric networks (those with 
a nontrivial automorphism group) necessarily contain a 
certain amount of structural redundancy. In accordance 
with the observation that common growth processes nat- 
urally lead to structural redundancy, many empirical net- 
works have richly structured automorphism groups p7] . 
In this paper we shall use the automorphism group to in- 
vestigate the effect of redundancy on network eigenvalue 
spectra. 

Since graph eigenvalues are well-known to be related 
to a multitude of graph properties [9J there has been 
considerable recent interest in studying the spectra of 
real-world complex networks and their associated models 
[ini [13| [T4| [15| [Tg D2, 33, 35 . These studies have high- 
lighted the fact that the spectral densities of real-world 
networks commonly differ significantly from those of the 
classical ensembles of random matrix theory [T3 [23] . For 
example, in [15] the spectral density of Barabasi-Albert 
'scale-free' networks [J and Watts-Strogatz 'small-world' 
networks [H] are considered. Barabasi-Albert networks 
are found to have a spectral density which consists of 
a 'triangle-like' bulk with power-law tails; while Watts- 
Strogatz small world networks are found to have multiple 
strong local maxima in their spectral densities which are 
related to the blurring of singularities in the spectral den- 
sity of the highly ordered /c-ring structure upon which the 
Watts-Strogatz model is based. 

Similarly, although they are not usually highly ordered, 
the spectral densities of real-world networks also often 
contain singularities. For instance singularities at the 
and —1 eigenvalues are common. Previous discussions 
have related the singularity at to local multiplicities 
in vertices of degree 1 (stars), and the singularity at —1 
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FIG. 1: High multiplicity eigenvalues can arise from a 
variety of network structures. The first graph has high- 
multiplicity eigenvalue but no stars, the second graph has 
high-multiplicity —1 eigenvalue with no cliques, and the third 
graph has both high-multiplicity and —1 eigenvalues, yet 
contains neither stars nor cliques. The first two graphs are 
examples of commonly ocurring symmetric motifs, as we ex- 
plain later. 



to complete subgraphs (cliques) [13 HH [HI 112^ although 
these explanations are not exhaustive. For example, the 
graphs in FIG.[T]have high multiplicity and —1 eigenval- 
ues which are not due to the presence of stars or cliques 
respectively. In general, since the relationship between a 
network and its spectrum is nontrivial, determining gen- 
eral conditions for the presence and strength of singular- 
ities in the spectral density is an open analytic problem 

Based upon the observation that high-multiplicity 
eigenvalues commonly associate with graph symmetries 
[24| we examined the relationship between network sym- 
metry and spectral singularities. Since symmetry can 
take many forms - cliques, stars and rings are all sym- 
metric, for example - symmetry provides a flexible frame- 
work for interpreting the effect of a wide variety of redun- 
dant network structures on eigenvalue spectra. 

The structure of the remainder of the paper is as fol- 
lows: In section |ll| we introduce some necessary back- 
ground material on network symmetry. In particular, 
we examine the relationship between network topology 
and automorphism group structure and show how certain 
subgroups of the automorphism group can be related to 
specific network motifs. In section [Illj we consider how 
a network's automorphism group interacts with its spec- 
trum, and discuss how specific eigenvalues and eigenvec- 
tors associate with these motifs. We study in detail the 
most frequent of these motifs and their contribution to 
the network's spectrum. Finally, we close with some gen- 
eral conclusions. 



II. BACKGROUND 

A network may be thought of as a graph, Q — 
g{V{g),E{g)), with vertex set, V{g) (of size N), and 
edge set, E{g) (of size M) where vertices are said to be 
adjacent if there is an edge between them. An automor- 




FIG. 2: A symmetric network. The permutation of the 
vertices given by the rotation r of 120° around the central 
vertex is an automorphism of the graph above, as are the 
refiections G\,a2 and 0-3 through each of the three arms. 
Together with a rotation of 240° and the identity (leaving 
every vertex fixed) they form the automorphism group G 
of the graph. Multiplication is composition and we have 
G — {1, r, r2, (Ti, CT2 ~ o-ir, — air^}. We say that the group 
G acts on the graph, because every element in G correspond 
to a permutation of the vertex set which preserves adjacency 
(G is the group of all such permutations). The orbit of a ver- 
tex V is the set of all vertices to which v can be sent by the 
action. Vertices are coloured by orbit: there are two orbits 
of size 3 and one orbit of size 1 (the central vertex is a fixed 
point of the G-action). 



phism is a permutation of the vertices of the network 
which preserves adjacency. The set of automorphisms 
under composition forms a group, G = Aut(5), of size ag 
[5] — see FIG.|2]for an example. We say that a network is 
symmetric (respectively asymmetric) if it has a nontriv- 
ial (respectively trivial) automorphism group. Since au- 
tomorphisms permute vertices without altering network 
structure, a network's automorphims group compactly 
quantifies the degree and nature of the structural redun- 
dancy it carries. This correspondence between network 
symmetry and redundancy forms the basis of the analysis 
we present in this discussion. 

The support of an automorphism p is the set of ver- 
tices which p moves, supp(p) — {vt G V{g) \ p{vi) ^ Vi}. 
Two sets of automorphisms P and Q are support-disjoint 
if every pair of automorphisms p € P and q € Q have 
disjoint supports. Additionally, we say that the auto- 
morphism subgroups Gp and Gq generated by P and Q 
are support- disjoint if P and Q are. If this is the case, 
pq — qp for all p G P and q € Q and hence xy = yx 
for all a; G Gp and y G Gq. Thus, if Gp and Gq are 
support-disjoint then we may think of them as acting 
independently on the network. 

This notion of independent action gives us a useful 
means to factorize the automorphism groups of complex 
networks into 'irreducible building blocks' [57]. In par- 
ticular, let g he a, network with automorphism group 
G — Aut(C/) generated by a set S of generators. Parti- 
tion S into support-disjoint subsets S = 5*1 U . . . U S*,! such 
that each Si cannot itself be decomposed into support- 
disjoint subsets. Call Hi the subgroup generated by Si. 
Since each Hi commutes with all others, we can con- 
struct a direct product decomposition of G from these 
subgroups: 

G^HixH2X...Hk. (1) 



This decomposition splits the automorphism group into 
smaller pieces, each of which acts independently on the 
network Q. If the set of generators S satisfies two simple 
conditions, the decomposition of Eq. [T| is unique (up to 
permutation of the factors) and irreducible 27J. In this 
case, we call each factor Hi a geometric factor and the 
direct product factorization given in Eq. [T] the geomet- 
ric decomposition of G = Aut(5). The motivation for 
this naming is that this factorization relates strongly to 
network geometry: each factor Hi may be related to a 
subgraph of ^, as follows. 

The induced subgraph on a set of vertices X C V{Q) is 
the graph obtained by taking X and any edges whose end 
points are both in X. We call the induced subgraph on 
the support of a geometric factor H a symmetric motif, 
denoted Mh- Thus H moves the vertices oi Mh while 
fixing the rest of the vertices oiQ, and is the smallest 
subgraph with this property. 

FIG. [3] shows an example network constructed from 
a variety of symmetric motifs commonly found in real- 
world networks, and its associated geometric decomposi- 
tion. Table |l] shows how the factors in the geometric de- 
composition of this network's automorphism group relate 
to distinct symmetric motifs in the network. Examples 
of geometric decompositions of real-world networks can 
be found elsewhere [27] . Note that for simplicity we con- 
sider networks as undirected graphs; a directed version 
of this decomposition is straightforward. 

Since large (Erdos-Renyi) random graphs are expected 
to be asymmetric [7 , symmetric motifs are commonly 
over-represented in real-world networks by comparison 
with random counterparts. Thus, they may (loosely) be 
thought of as particular kinds of motifs (although undi- 
rected) as studied by Milo and co-workers 1^0,. However, 
our definition is much more restrictive than that of Milo 
and co-workers since we single out motifs preserved by 
any (global) symmetry of the network. Although this re- 
striction means that we consider only a small subset of 
possible network motifs, it is useful since the presence 
of symmetric motifs may be directly linked to network 
spectra in a way which is not possible for general motifs. 



III. SYMMETRY AND REDUNDANCY IN 
NETWORK SPECTRA 

The presence of singularities in the eigenvalue spec- 
tra of real-world networks has been previously observed 
and reasons for certain of these peaks has been dis- 
cussed [12 HH nil [32]. In this section we aim to extend 
these previous results by outlining a formal framework in 
which to consider general spectral characteristics of re- 
dundancy. We do so by considering interactions between 
a network's automorphism group and the eigenvalues of 
its adjacency matrix. 

The adjacency matrix of a simple network Q is the 
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FIG. 3: An example network and its quotient. A net- 
work with Aut(e) = ^2 X ^2 X ^2 X X ^4 X ^2 X {S2 I S2) 
(top), and its quotient (bottom). We write Sn for the group 
of all permutation of n objects and ; for the wreath product 
[36j . a mild generalization of the direct product. Vertices are 
coloured by orbit. Note that the quotient is a multigraph 
but, for clarity, edge weights and directions have not been 
represented. 



N X N symmetric matrix 

_ f 1 if ■'^i and vj are adjacent, 
'■^ 1 otherwise. 

The eigenvalues of G are the eigenvalues of its adjacency 
matrix, and the set of eigenvalues is the network's spec- 
trum. For undirected networks, the matrix A is symmet- 
ric and therefore all eigenvalues are real and there is an 
orthonormal basis of eigenvectors. For the remainder of 
this discussion we shall focus on simple undirected net- 
works. 

The spectral density of a simple network Q is the den- 
sity of its eigenvalues, which can be written as a sum of 
Dirac delta-functions 

1 ^ 

pW = j^T.^i^->^^)^ (2) 

i=l 

where Xi is the ith largest eigenvalue of G- 

Consider p, a permutation of the vertices of G, which 
can be represented by a permutation matrix P where 

p ^ p.. ^ f 1 if P(v») = Vj, 
) otherwise. 

The relationship between network symmetry and eigen- 
value spectra depends centrally upon the fact that p e 
Aut(tJ) if and only if A and P commute [24 . Thus, if x 
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Sym. Motif Geom. Factor 



Eigenvalues 



^ (>• 

o 



^2 [-r,-i,r,i] 

5*2 and 52 [-2,0*,0*,2] 

53 hl*,-l*,2] 
Sa [0*,0*,0*,0] 

& [-r,-i,r,i] 

S2;S2 [-v^*,-v^,0*,0*,%/2*,\/2] 



TABLE I: Symmetric motifs, their associated geomet- 
ric factors and eigenvalues. Vertices are coloured by orbit, 
ghost edges and vertices show how the symmetric motif at- 
taches to the network. In the second motif, the action is inde- 
pendent in each orbit, hence is given as two geometric factors. 
Redundant eigenvalues (see Section III B I are starred. Notice 



how different symmetric motifs give rise to the same redun- 
dant eigenvalues. The complete spectrum this network is as 
follows: -2.7337, -2.3923, -2.2758, -2.0291, -1.8546, -1.4181, 
-1.4142*, -1.1559, -1*, -1*, -1*, -1*, -0.2251, 0*, 0*, 0*, 0*, 
0*, 0', 0*, 0, 0.2712, 0.3812, 0.7218, 1*, 1', 1.4142*, 1.7570, 
1.9740, 2.2323, 2.4236, 2.9431, 3.3804. Fift een of these eigen- 
values are redundant (starred, see section III B I and the re- 
maining 18 form the spectrum of the quotient graph (see sec- 
tion [llTA|^This situation is general and will be explained in 
Section nil 51 



is an eigenvector of A corresponding to the eigenvalue A 
then Px is also an eigenvector of A corresponding to A. 
Since Px and x are generally linearly independent, this 
means that network symmetry (and thus redundancy) 
naturally gives rise to eigenvalues with high multiplicity 
and therefore singularities in the spectral density. In the 
following sections we shall develop this result a little fur- 
ther and show how certain network eigenvalues may be 
associated directly with symmetric motifs. First we need 
to recall the notion of quotient graph. 



A. Network Quotients 

Since automorphisms permute vertices without alter- 
ing network structure, a network's automorphism group 
may be used to partition its vertex set V{Q) into dis- 
joint strutural equivalence classes called orbits (see FIG. 
[2]). For every vertex v G V{Q), the set of vertices to 



which V maps under the action of the automorphism 
group G = Aut(t/) is called the G-orbit of u, written 
IS.q{v) or simply A(w). More formally, 

^G{.v) = {g-veV -.geG}. 

Similarly, if iJ is a subgroup of G, the iJ-orbit of a vertex 
V is the set 

Aff (f ) = {5 • « e ^ : <? e i/}. 

Since vertices in the same orbit may be permuted without 
altering network structure, they are structurally indistin- 
guishable from each other (that is, they play precisely the 
same topological role in the network). Thus, a network's 
orbit structure efficiently quantifies the degree of struc- 
tural redundancy the network carries. For example, the 
vertices in FIG. |3] are coloured by orbit. 

Since the vertices in each orbit are structurally equiva- 
lent, they may be associated with each other to form the 
basis of a network coarse-graining known in the context 
of algebraic graph theory as the quotient graph. More 
specifically, let A = {A(wi), A(w2) . . . , A(?;s)} be the sys- 
tem of orbits which the vertices of Q are partitioned into 
under the action of G. Let qij = 1, 2, . . . , s) be the 
number of edges starting from a vertex in A^ and ending 
in vertices in Aj. Since the orbits partition the vertex 
set into disjoint equivalence classes, Qij depends on i and 
j alone. The quotient Q oi Q under the action of G is 
the multi-digraph with vertex set A and adjacency ma- 
trix (qij). We refer to the network Q as the parent of Q. 
Crucially, the quotient of Q retains the unique structural 
elements of Q yet, by associating structurally equivalent 
elements, factors out all redundancy. Previous reports 
have shown that quotients of many empirical networks 
can be as small as 20% the size of their parent networks 
yet preserve precisely key network properties which de- 
termine system function [15] . Note that we can similarly 
define the quotient of Q under the action of any subgroup 
H oi G (hence factoring out just a fraction of the redun- 
dancy) . 

A key result for the present discussion is that, for any 
given graph Q, set of eigenvalues of its quotient are a 
subset of those of G [H]- Given a graph Q with orbits 
Ai, . . . , Ajn and an eigenpair (A, v = {vi, . . . , Vm)) of the 
quotient graph Q, then A is also an eigenvalue of the 
parent network Q with an eigenvector consisting on an 
identical value Vi on all the vertices of A^. Thus, a net- 
work's automorphism group may be used to construct a 
factorization of its characteristic polynomial, via its quo- 
tient. Additionally, since quotients carry less repetition 
than their parent networks, we find that quotient spectra 
generally contain less degeneracy than their parent net- 
works. FIG. |4] illustrates this point by giving the spectral 
densities of 6 representative (biological, social and tech- 
nological) networks and their quotients. As expected, in 
each case the spectral density of the parent network con- 
tains peaks which are significantly reduced in the spec- 
tral density of its quotient. In the following section we 
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FIG. 4: Spectral densities of networks and their quo- 
tients (color online). In all cases, the spectral density of the 
parent is in dark grey (blue online) while that of the quotient 
is in light grey (red online), (a) the c. elegans genetic regu- 
latory network (b) The www.epa.gov subnetwork f531 (c) 
A media ownership network [32] (d) A network between PhD 
students and their supervisors [121 155] (e) The US power grid 
|41| (f) The yeast protein-protein interaction network [20] . 
Note that the y-axis is on a logarithmic scale: in each case, 
the differences in redundant eigenvalue multiplicities between 
the parent network and its quotient are significant (see Table 
VTl. 



1* (1,"1,0,|1,-1,0,|0)* 

1* (1,0,-1,|1,0,-1,|0)* 

-1* (1,-1,0,1-1,1,0,10)* 

-1* (1,0,-1,1-1,0,1,10)* 
2 (1, 1, 1, |2,2,2, |3) 

-2 (1,1,1,1-2,-2,-2,13) 

(1,1,1,10,0,0,1-1) 



1* (0,|1,-1,0,|1,-1,0,|0)* 

1* (0,|1,0,-1,|1,0,-1|0)* 

-1* (0,|1, -1,0,1- 1,1, 0,|0)* 

-1* (0, |1, 0,-1, I - 1,0,1, jo)* 

Ai (-A2,|l,l,l,|l,l,l,|-A2) 

Aa (-Ai,|l,l,l,|l,l,l,|-Ai) 

-Ai (A2,|l,l,l,|-l,-l,-l,|-A2) 

-Aa (Ai,|l,l,l,|-l,-l,-l,|-Ai) 



Ai 

A2 

-Ai 

-A2 



(1,2,3) 
(1,-2,3) 
(1,0,-1) 

(-A2,l,l,-A2) 

(-Ai,l,l,-Ai) 

(A2,l,-1,-A2) 

(Ai,l,-1,-Ai) 



will make this relation more explicit by associating spe- 
cific network eigenvalues with specific symmetric motifs. 
These, together with the eigenvalues coming from the 
quotient, describe the entire spectrum of the network. 



B. Symmetric Motifs and Network Spectra 

There have been some previous attempts to spot the 
eigenvalues of key subgraphs in network spectra [2^ . 
However subgraph eigenvalues are not usually contained 
in network spectra, and in general they only interlace 
those of the network [TT]. Nevertheless, certain eigen- 
values associated with symmetric motifs are retained in 
network spectra. We call them redundant eigenvalues, 
and they are described as follows. 

Recall the physical meaning of a eigenvalue-eigenvector 
pair of an undirected graph. Consider a vector v on the 
vertex set of a graph, and write Vi for the value at a 
vertex i. Write on each vertex the sum of the numbers 
found on the neighbours of that vertex. If the new vector 
is a multiple of v, say Av, then v is an eigenvector with 
eigenvalue A. We shall say that an eigenvalue-eigenvector 
pair (A,v) of a symmetric motif Ai — Ain (considered 
as an induced subgraph) is redundant if, for each iJ-orbit 
Ah € M, the sum J^ieAn ^« ~ ^'^^ example, in Ta- 
ble [n] the redundant eigenvectors are starred: the coor- 
dinates are separeted by orbits and the sum over each 
orbit is zero. Indeed, it can be shown that if M has n 



TABLE II: Examples of redundant spectra. Two sym- 
metric motifs (top two rows) and their quotients (bottom two 
rows) are shown. Vertices are coloured by orbit and ghost 
vertices and edges show how each motif attaches to a (hy- 
pothetical) network. In both ca ses th e underlying symmetric 
motif is V3 = V3 (see Section III C and compare with Ta- 
ble |v]l with geometric factor S3, permuting each orbit simul- 
taneously. Eigenvector entries are separated by orbit. The 
eigenvalues Ai ~ 2.30, and A2 ~ —1.30 are the solutions of 
A^ — A — 3 = 0. Redundant eigenvectors (the sum of the en- 
tries on each orbit is zero) and their eigenvalues are starred. 
The redundant eigenvalues are the same in both cases, while 
the non-redundant ones vary. Note that the non-redundant 
eigenvectors are constant in each orbit. Observe also that the 
number of redundant eigenvectors equals the number of ver- 
tices minus the number of orbits (see Appendix [AJ and the 
quotient graphs retain exactly the non-redundant part of the 
spectrum. 



vertices and m iJ-orbits, there is an orthonormal basis 
of eigenvectors of A4 such that n — m of them are redun- 
dant, and the remaining m are constant on each orbit 
(see Appendix [A| . 

We say that an eigenvalue A is redundant with multi- 
plicity m if there are up to m linearly independent eigen- 
vectors vi, . . . ,Vm such that all the pairs (A, v^) are re- 
dundant. For example, the eigenvalue in the fourth 
motif of Table |T] has multiplicity 4 but redundant multi- 
plicity 3. The crucial property is that redundant eigen- 
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values are retained, with their redundant multipHcity, in 
the network spectrum: if (A, v) is a redundant eigenvalue- 
eigenvector pair of a symmetric motif M. then (A, v) is an 
eigenvalue-eigenvector pair for the whole network, where 
V is formed by setting Vi = Vi for alH £ Al and setting 
Vi = Q for all i ^ ['^- We call such an eigenvector 
M.-local: it is constructed from a redundant eigenvector 
of a symmetric motif by setting entries to zero on the 
vertices outside M. 

The non-redundant eigenvalues of will not, in gen- 
eral, be retained in the network spectrum but rather will 
change depending on how the motif is embedded in the 
network (more precisely, on the topology of the quotient 
graph) - for instance, see the examples in Tables HI and 

El 

Remark: The argument above applies naturally to 
symmetric motifs but not necessarily to single orbits: a 
redundant eigenvector of an orbit will not necessarily give 
an eigenvector of the whole network (see for instance the 
closing remark on Table |v]) . The reason is that it may 
not be possible to treat one orbit on its own if the action 
is not 'independent' on this orbit. The smallest indepen- 
dent actions (and their associated subgraphs) are pre- 
cisely given by the geometric factorization of Eq. [l] The 
symmetric motifs are the smallest subgraphs whose re- 
dundant eigenvalues survive to the spectrum of the whole 
network. 

On the other hand, consider the quotient graph of a 
network Q. Recall that if (A,v) is an eigenpair of the 
quotient then (A, v) is an eigenpair of Q, where v is ob- 
tained setting the identical value Vi on all the vertices of 
the ith. orbit. We say that the eigenvector of the parent 
network v is lifted from the eigenvector v of the quotient. 

The key result is that these two procedures explain 
completely the whole spectrum oi Q: li Q has n ver- 
tices and m orbits, we can find a basis of eigenvectors 
Vi, . . . , v„i, v„i4-i, . . . v„ such that the first m are lifted 
from a basis of eigenvectors of the quotient vi, . . . ,Vm 
and the remaining come from the redundant eigenvectors 
of the symmetric motifs of Q . See Appendix [S] for full 
details and Table [IT] for examples. Finally, note that the 
Vi's are constant on each orbit and the v^'s are redundant 
on each orbit (the sum of the coordinates is zero) . 

Recall that the spectrum of the quotient graph is a sub- 
set of the spectrum of the parent network. The redundant 
eigenvalues are exactly the ones 'lost' in the spectrum of 
the quotient graph (Appendix [A| . Hence the proportion 
of a network's spectrum due to redundancy is obtained 
by comparing the size of the parent graph to the size of 
its quotient. This varies from network to network but 
can be as small as 20% [27]. Thus this phenomena is 
non-trivial and can account for up to 80% of the network 
spectrum. 

Until now we have been counting repeated eigenvalues 
separately (that is, we have considered eigenpairs after 
fixing an appropriate basis of eigenvectors). What can 
we say about the multiplicity of these redundant eigen- 
values? There is no general principle beyond the general 



rule of thumb that the multiplicity is directly correlated 
to the size of the automorphism group. For example, if a 
network has an orbit of n vertices such that all the per- 
mutations of these vertices are allowed (ie. Sn acts natu- 
rally on the orbit) then there will be a redundant Al-local 
eigenvalue with multiplicity at least n — 1, (see Appendix 
[C| . Conversely, a graph with only simple eigenvalues has 
an automorphism which is a subgroup of 5*2 x . . . x S'2 

One obvious question remains: what are the possible 
redundant eigenvalues associated with symmetric motifs? 
In principle, there is no restriction so we should rephrase 
the question as: what are the most commonly ocurring 
redundant eigenvalues in 'real-world' networks? We now 
address this question by focussing on the most commonly 
ocurring symmetric motifs. 



C. Basic symmetric motifs 

Most symmetric motifs (typically more than 90%) 
found in real-world networks conform to the following 
pattern [27]: they consist of one or more orbits of n ver- 
tices (n > 2) with a natural symmetric action, that is, the 
geometric factor H (the subgroup of symmetries permut- 
ing only vertices of the motif) consists of all the permu- 
tations of the n vertices of each orbit and hence H = Sn- 
Therefore, each i?-orbit is either the empty graph Vn, or 
the complete graph Kn, on n vertices. Every vertex not 
in the motif is a fixed point with respect to H and hence 
is joined to either all or none of the vertices of each orbit. 
Moreover, two orbits may be joined in one of only four 

(for a proof see [26]). 
l] would be, in this no- 
V2, while the 



possible ways shown in Table III 



For example, the graphs in Table 
tation, V2 = V2, V2*V2, K3, V4 and V2 
last graph does not follow this pattern. 

We call a symmetric motif as above a basic symmetric 
motif (BSM), while all others which do not conform to 
this pattern we call complex. Complex motifs are rare 
[27] and their spectrum can be studied separately. How- 
ever, since they have a constrained shape, it is possible 
to systematically analyze all the possible contributions 
that BSMs make to the spectra of the whole network. In 
particular, specific network eigenvalues may be directly 
associated with BSMs. We have carried this analysis out 
for BSMs up to 3 orbits. In all cases, each redundant 
eigenvalue of a BSM will have multiplicity a multiple of 
n — I (Appendix [C]) . 

There are two symmetric motifs with one orbit, Kn and 
Vn, and they are both basic. Their spectrum is shown in 

for the (redundant) 



Table IV 



We use the notation 
vector with non-zero entries 1 in the first position and 
— 1 on the ith position {2 < i < n), and 1 for the vector 
with constant entries 1. 

As predicted, each motif has a redundant eigenvalue 
of multiplicity n — 1, which survives as an eigenvalue of 
the same multiplicity in the spectrum of any network 
containing such a subgraph as a symmetric motif. This 
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Orbits 



Graphic notation Written notat. 



Notation Sym. motif Eigenvalue Red. Mult. Eigenvectors 



o o o 
o o o 



o o 



Ai o A2 




Ai * A2 



Ai 




Ai [XI A2 



TABLE III: Joints of two orbits in a basic symmetric 
motif. Two orbits of n vertices can be joined in one of these 
four ways (possibly after a suitable permutation of the ver- 
tices): each vertex is joined to either none, all, exactly one 
or exactly n — 1 of the vertices of the other orbit. Each orbit 
can be either a complete or an empty graph on n vertices. 
To illustrate these joints we have taken both orbits to be V3 
(hence the graphs are bipartite) although the same argument 
holds in the more general case. 



Notation Sym. motif Eigenvalue Multiplicity Eigenvectors 


• Kn 


-1* 

n-1 


n-1 
1 


1 


K 


0* 



n-1 
1 


1 



TABLE IV: Spectra of symmetric motifs with 1 orbit. 

The geometric factor is always Sn ■ Redundant eigenvalues are 
starred. Notice that is an eigenvalue of Vn with multiplicy 
n but redundant multiplicity n — 1. 



amounts to the usual association of the —1 and eigen- 
values to cliques and stars respectively, as discussed in 
previous publications. However, our general setting now 
allows us to go further. 

Before moving on we make two brief observations. 

Firstly, note that the following BSMs cannot appear 
in practice. Call a BSM reducible if it has an 77-orbit 
A joined to all other i?-orbits by joints of type '*' 
or 'o' (Table lnT|, that is, A * Aj or A o Aj for all j. 









0* 


n-1 


{{ei\ei)} 






= Kn 


-2* 

n 
n — 2 


n - 1 
1 
1 


UeA — ei)} 

L V ^1 ' / J 
(lil) 
(ll-l) 








1* 


n-1 


{(ei|ei)} 




Vn 


= Vn 


-1* 
1 

-1 


n-1 
1 
1 


{(e,i-ei)} 
(lil) 
(1|-1) 










n-1 


{(AiCjIci)} 




Kn 


= Vn 


an 

bn 


n-1 
1 
1 


{(A2ei -ej)} 
(a„l|l) 

(bnl|-l) 



TABLE V: Spectra of basic symmetric motifs with 2 
orbits. Redundant eigenvalues are starred. Eigenvector co- 
ordinates are separated by orbit {x\y). The eigenvalues A; are 



the roots of A^ -I- A - 
and A2 = —ip = - 



1, that is, Ai 



1 



0.6180 



-1.6180, where </3 is the golden 



ratio. For completeness, we also give a„ = 

n'^ -2n + 5 



n-1 I \/ n^— 2n + 5 
2 ' 2 



and bn — 



although they are not redun- 



2 2 

dant. Observe that the redundant eigenvalues of each single 
orbit (—1 and for Kn respectively Vn) do not ocurr in the 
spectrum of the corresponding BSM. 



In this case we would obtain an independent geometric 
factor of type Sn just permuting the vertices of A. For 
example, the second motif of Table |l] (a bifan) has ^2 
and ^2 as geometric factors. Such motifs are included in 
our analysis as two separate symmetric motifs. Secondly, 
consider the complement Q oi a. graph Q, that is, the 
graph with same vertex set and complement edge set (two 
vertices are joined in Q if and only if they are not joined 
vaQ). Note that the complement of a BSM is also a BSM, 
replacing Kn by V^, * by o, = by [xi, and viceversa. If A 
is an eigenvalue of a BSM with multiplicity p > \ then 
—A — 1 is an eigenvalue of the complement BSM with the 
same multiplicity [45 . 

There are 12 BSMs with two orbits of n vertices: 6 of 
these are non-reducible and it is sufficient to compute 3 
cases, since the other 3 are their complement. Table [V| 
summarizes the results. The first two motifs have com- 
plementary spectra while the third is self-complementary. 
Observe that —1 and arise again as redundant eigen- 
values (and hence survive in the network's spectrum), 
however, this time they are associated with motifs other 
than stars or cliques. 

Define RSpec^ as the set of redundant eigenvalues of 
basic symmetric motifs up to m orbits. We have shown 
so far that 



RSpeCj = {—1,0} and 
RSpec2 = {— 2, — (y9, — 1, 0, (/? - 



1,1}, 
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[-^^-y5,0^...,0^0,^/5^^/5] 

FIG. 5: A complex symmetric motif and its spectrum. 

This complex motif appears in the network of ties between 
PhD students and their supervisors 12, jSSj. The redundant 
eigenvalues of this motif (starred) survive in the spectrum of 
the network as a whole. 



where Lp is the golden ratio. 

For m > 3 orbits, exactly the same analysis may be 
conducted. However, the number of possible different 
BSMs with TO orbits increases dramatically with to. We 
have nevertheless computed the redundant eigenvalues 
of most BSMs with 3 orbits, as shown in Table VI 46J. 



Observe that the 20 non-complementary BSMs organ- 
ise themselves into 7 different redundant spectrum types. 
We have therefore shown that: 

{ - 3, -2, -1,0, 1, ±\/2, ±73, -1 ± 72, -1 ± VS, 
//l,/i2,M3,J^l,'^2,l^3} C RSpecg. 

It would be interesting to find out all the possible 
eigenvalues of BSMs of any number of orbits, if there is 
a pattern. However this is a purely mathematical prob- 
lem since their relevance (i.e. frequency) in real- world 
networks decays rapidly with the number of orbits. 

In order to place these abstract results in a more con- 
crete setting, we have computed spectral characteristics 
of redundancy in the real-world empirical networks of 
whose spectra are given in FIG |4j All high- multiplicity 
eigenvalues of these networks are listed in Table |VlT] Note 
that, with the exeception of ±-\/5 in the spectrum of the 
network of ties between PhD students and their super- 
visors - which comes from the complex motif shown in 
FIG [5]- each redundant eigenvalue is in our set RSpec3. 



IV. CONCLUSIONS 

Due to the forces which form and shape them, many 
real-world empirical networks contain a significant am- 
mount of structural redundancy. Since structurally re- 
dundant elements may be permuted without altering net- 
work structure, redundancy may be formally investigated 
by examining network automorphism groups. By consid- 
ering the relationship between network topology and au- 
tomorphism group structure, we have shown how specific 
automorphism subgroups may be associated with specific 
network motifs. Furthermore, we have shown that cer- 
tain network eigenvalues may be directly associated with 
these symmetric motifs. Thus, we have explained how 



the presence of a variety of local network structures may 
be seen in network spectra and have shown that the por- 
tion of a network's spectrum associated with symmetric 
motifs is precisely the part of the spectrum due to re- 
dundancy. In addition we have computed the redundant 
spectrum of the most common symmetric motifs up to 3 
orbits and any number of vertices and demonstrated their 
presence in a variety of real- world empirical networks. 

Although the theoretical details are somewhat in- 
volved, in practice it is extremely easy to find the re- 
dundant portion of a networks spectrum and its associ- 
ated symmetric motifs, even for large networks, using the 
nauty algorithm |28j and a computational group theory 
package such as GAP [16] . 

In summary, the symmetry approach we have outlined 
in this paper confirms previous results connecting net- 
work spectra with simple local network structures. Ad- 
ditionally, since symmetry can take many forms, this ap- 
proach also extends these results by providing a general 
means to relate network eigenvalues to a variety of dis- 
parate network structures in a simple, flexible algebraic 
manner. However, our results are limited by the very na- 
ture of the automorphism group: only global symmetries 
are taken into account, and they fail to measure other 
internal symmetries (as opposed to the purely combina- 
torial motifs of Milo and coworkers [3D]), since they are 
very sensitive to the addition of new vertices. It would be 
interesting to relax the group notion to that of a groupoid 
[34] to see if these results can be extended in this more 
general setting. 
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APPENDIX A 

Let C/ be a graph with n vertices and adjacency matrix 
A = (oij). Suppose that the action of G = Aut(CJ) on 
Q has TO G-orbits. We show that there is an orthogonal 
basis of eigenvectors vi , . . . , w„ such that wi , . . . , w,„ are 
constant on each G-orbit and Wm+i: ■ ■ ■ ^'^n are redundant 
(the sum of the coordinates at each G-orbit is zero). 

The proof follows is a consequence of well-known re- 
sults in graph theory (see for instance Chapters 8 and 
9 in [17]). A partition tt = {Gi, . . . , G^} of the vertex 
set of Q is called equitable if the number of neighbours 
in Cj of any vertex in Ci is a constant bij. For example, 
the orbits of any subgroup of Aut(Q) gives an equitable 
partition. The quotient of G by an equitable partition tt, 
denoted G /tt, is the directed multigraph with r vertices 
and adjacency matrix B — (bij). The characteristic ma- 
trix of a partition tt is the n x r matrix P — (pij) such 
that pij = 1 if the ith vertex of G belong to Cj and 
otherwise. That is, in column notation P = {wi \ . . . \wr) 
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with Wj the vector with I's in the vertices of Cj and 
elsewhere. We have that P is the characteristic matrix 
of an equitable partition if and only if 



AP ^ PB, 



(Al) 



since the {i, j)-entTy of either matrix is the number of 
neighbours of the ith vertex in Cj . A subspace U is called 
A-invariant if Au G U for all u £ U. Note that (Al) 



is equivalent to saying that the space W spanned by the 
columns of P is A-invariant. One can show |17j that every 
non-zero A-invariant subspace has an orthogonal basis of 
eigenvectors. Furthermore, the orthogonal complement 
of an A-invariant subspace if also A-invariant |T7j 8.4.3]. 
Consequently, we can write M" = W (B and find an 
orthogonal basis of eigenvectors of W and another for 
. Finally note that: 

(1) dim(T4^) ^ r. 

(2) u £ W u is constant on each Cj . 

(3) ueW^ the sum of the coordinates of u on each 
cell is zero. 



APPENDIX B 

Suppose that is a graph with n vertices and m G- 
orbits, where G — Aut(C/). Consider the associated geo- 
metric decomposition, G — Hi x H2 x . . . Hk and corre- 
sponding symmetric motifs Aii,. . . , M.k- Suppose that 
M.i has rii vertices and rrii TJ^-orbits (which then coin- 
cide with the G-orbits) . Call no to the number of fixed 
points in Q. Then we have 



ni 



Tik -\- TiQ = n and mi + . . . + nik + tiq ^ m . 



For each motif ^Ai we can apply the result in Appendix 
[A| to find an orthogonal basis of eigenvectors such that 
rii — rrii of them, say {v*}, are redundant. Hence they 
give A^i-local eigenvectors {vj } of Q, for each 1 < i < fc. 
Note that the v*'s are pairwise orthogonal and hence in 
particular are linearly independent. 

Now choose an orthogonal basis of eigenvectors 
of the quotient, {wi, . . . , Wm}. Each is an 

eigenvector of Q, constant on each orbit. Then 
{wi,...,Wm} U {v*} is an orthogonal system of 
m + (ni — mi) + . . . {uk — ruk) = m + n — no — m + no — n 
vectors, that is, an orthogonal basis of eigenvectors of Q. 



APPENDIX C 

Let A4he a graph with an orbit of n vertices xi, . . . ,Xn 
such that all n\ permutations of the vertices are automor- 
phisms of Ai. We demonstrate that there is a redundant 
eigenvalue A of redundant multiplicity at least n — I. 

We can assume that n>2. Let (A, v) be a redundant 
eigenpair (there is at least one, by Appendix |A|. Suppose 
that vi, . . . ,Vn are the entries of v at xi, . . . , a;„. Recall 
that any permutation of the Vi's (fixing the other entries) 
gives an eigenvector of the same eigenvalue. Since v is 
redundant, it cannot be constant on the orbit, thus we 
can assume without loss of generality that Vi ^ V2- Let 
cr be a permutation interchanging the first and second 
coordinates while fixing the other n — 2 entries in the or- 
bit. Thus u — fTw is a multiple of the vector with values 
(1,— 1,0,...,0) on the x^'s. Further permuting the coor- 
dinates gives n — \ linearly independent eigenvectors of 
A, as required. 
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Notation 



Red. Mult. 



-A - 1 




-1 2(n-l) 
2 n - 1 



n-1 
V2 n-1 
-\/2 n-1 




2(n-l) 
n-1 




-1 


n-1 




n-1 


-V3 


n-1 




-1 

-1 + V2 



-1 + ^3 



V2 



Network 


A m-p ruQ 


c.elegans GR 


-1 147 6 
212 45 


epa.gov 


-1 23 

2532 518 

1 8 4 


media 


-2 2 
-V2 13 6 
-1 32 6 

3621 119 

1 33 7 
V2 13 6 


PhD 


-v^ 2 1 
-V3 3 3 
-\/2 6 
-1 27 4 

507 51 

1 27 4 
V2 6 
VS 3 3 

2 1 


US Power 


-2.9150 2 2 
-V? 5 
-V2 13 3 
-1 73 15 

593 241 
ifi-l 5 

1 40 14 
1.1552 2 2 
1.4068 2 2 

V2 14 4 


Yeast PPI 


-\/2 2 
-1 28 9 

564 154 

1 9 2 
V2 2 



Ml 


n — 


1 


1^1 




n — 


1 




M3 


n — 


1 


V3 



n-1 
n-1 
n-1 



TABLE VII: High multiplicity eigenvalues in empirical 
networks. All high-multiplicity eigenvalues A of the net- 
works of FIG.|4] are given along with their multiplicity m-p in 
the parent network and multiplicity mg in the quotient net- 
work. The redundant multiplicity mp — niQ is explained by 
the symmetry on the network, as described in the main text. 
Observe that all redundant eigenvalues (m-p — niQ > 0) are 
in the set RSpeCg except ±\/5, which is due to the complex 
motif in FIG. [5] Note that the redundant eigenvalues may 
nevertheless come from different BSMs or even from complex 
motifs in some cases. 



TABLE VI: Spectra of basic symmetric motifs with 3 
orbits. Only redundant eigenvalues A are shown, and their 
complements —A — 1, corresponding to complement motifs. 
Here fii are the roots of the polynomial p(A) = A'^ + A^ — 2A— 1, 
that is, /ii « -1.8019, ^2 « -0.4450 and ^3 ~ 1.2470. The 
complements i/i — — 1 — /li are the roots of the polynomial 
p(-l - A) = -A^ - A^ + A + 1: 1^1 ^ -2.2470, U2 ~ 0.5550 
and V3 « 0.8019. 



